Summary

Adds Classroom Life - an AI-powered 3D classroom simulation that diagnoses student understanding and provides personalized tutoring with voice interaction.

🏆 Winner of the Agent Olympics Hackathon 2026 "Best use of ElevenLabs" Challenge

Project Highlights

Classroom Life features an immersive 3D classroom environment where an AI tutor interacts with simulated students. The system uses a two-phase approach:

• Diagnostic Phase (turns 1-5): Strategic conversations to gauge each student's understanding level without teaching
• Tutoring Phase (turns 6-10): Personalized instruction adapted to the diagnosed mastery level (1-5)

Key Features

• Adaptive AI Tutoring: 10-turn conversations with LLM-based understanding assessment using educational rubrics
• Immersive Voice Experience: Each student has a unique ElevenLabs voice matching their personality (shy, confident, anxious, etc.)
• Voice Input for Tutors: Speak your tutoring responses using ElevenLabs speech-to-text
• 3D Classroom Visualization: Interactive React Three Fiber scene with speech bubbles synced to audio playback
• Educational Image Generation: AI-generated visual aids displayed on the classroom monitor
• Student Personalities: Simulated students with distinct personalities (easily distracted, perfectionist, unmotivated, overconfident, shy)

ElevenLabs Integration

• Text-to-Speech: Uses eleven_multilingual_v2 with 6 distinct voice configurations, each with per-character voice settings (stability, similarity boost) to create unique student personalities
• Speech-to-Text: Uses scribe_v2 for voice input transcription, enabling tutors to speak their responses naturally

Project Links

• Repository: https://github.com/elhould/hackathon-track1

Technologies Used

• ElevenLabs API (TTS with eleven_multilingual_v2, STS with scribe_v2)
• OpenAI (GPT-4o-mini for student simulation, tutor responses, and level prediction; gpt-image-1-mini for educational illustrations)
• React Three Fiber for 3D classroom rendering
• React + TypeScript + Vite
• Express.js backend
• Tailwind CSS + shadcn/ui

Rights Confirmation

I confirm that I have the rights to share this project publicly.

Social Media

• X/Twitter Handle: @yesoktheyknow